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Abstract. We consider a bounded step size random walk in an ergodic random environment with some ellipticity, on 
an integer lattice of arbitrary dimension. We prove a level 3 large deviation principle, under almost every environment, 
with rate function related to a relative entropy. 

Resume. Nous considerons une marche aleatoire en environment aleatoire ergodique. La marche est elliptique et a 
pas bornes. Nous prouvons un principe de grandes deviations au niveau 3, sous presque tout environnement, avec 
une fonctionnelle d'action liee a une entropie relative. 
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1. Introduction 

We describe the standard model of random walk in random environment (RWRE) on Z'^. Let ft he a Polish 
space and 6 its Borcl cr-algebra. Let {T^ : z G Z'^} be a group of continuous commuting bijections on 57: 
Tx-i-y = T^Ty and Tq is the identity. Let P be a {T^j-invariant probability measure on (fl, &) that is ergodic 
under this group. In other words, the cr-algebra of Borel sets invariant under {Tz} is trivial under P. 

Denote the space of probability distributions on Z'^ hy V ^ {iPz)zei,'' ^ [0,1]^ : X^z-P^ ~ 1} ^^'^ 
give it the weak topology or, equivalently, the restriction of the product topology. Let uj H> (pz(w))zgz<' 
be a continuous mapping from f2 to V. For x,y G ifi define 772,^^(0;) = py-x{TxUj). We call uj and also 
{'^x,yi^))x,yeZ'' environment because it determines the transition probabilities of a Markov chain. 

The set of admissible steps is denoted by = {z : E[7ro,z] > 0}. One can then redefine V = {{pz)z&m & 
[0, : X^zPz = 1} and transition probabilities tt^. ,y are defined only for a;, y € Z"^ such that y — x £ M. 

Given a; and a starting point x e Z'', let be the law of the Markov chain X^ aa ~ {Xn)n>o on Z*^, 
starting at ~ x and having transition probabilities (tt^ That is, 

Px{Xn+i = y + z\ Xn = v] = TTy,y+z{uj), for all y, z G Z''. 
1 Supported in part by NSF Grant DMS-0747758. 
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Xq^oo is called a random walk in environment cj and is called the quenched distribution. The joint 
distribution is Px{dxo,oo,dLL!) ~ P^{dxQ,oo)P{dLL'). Its marginal on is also denoted by P^ and called 

the averaged (or annealed) distribution since uj is averaged out: 



P^{A) = J P^{A) F{duj) for a measurable A C {Z'^f+. 



The canonical case of the above setting is f2 = and Pz(w) = (<jJo)z- 

Next a quick description of the problem we are interested in. Assume given a sequence of probability 
measures Q„ on a Polish space {X, SSx) and a lower semicontinuous function / : A" — > [0, oo]. Then the large 
deviation upper hound holds with rate function I if 

lim n^^ \ogQn{C) < — inf / for all closed sets C C X. 

n— >cjo C 

Similarly, rate function / governs the 7arge deviatioji lower bound if 
lim n^^ log Q„{0) > — inf / for all open sets O C X. 

n— >oo O 

If both hold with the same rate function /, then the 7argc deviation principle (LDP) holds with rate /. 
We shall use basic, well known features of large deviation theory and relative entropy without citing every 
instance. The reader can consult references [3], [4], [5], [15], and [21]. 

If the upper bound (resp. lower bound, resp. LDP) holds with some function I : X [0, oo], then it also 
holds with the Jower semicontinuous regularization /isc of / defined by 



Iisc{x) ~ sup I ijif : X E O and O is open|. 



Thus the rate function can be required to be lower semicontinuous, and then it is unique. 

Large deviations arrange themselves more or less naturally in three levels. Most of the work on quenched 
large deviations for RWRE has been at level 1, that is, on large deviations for P^{X„/n g •}. Greven and 
den Hollander [10] considered the product one-dimensional nearest-neighbor case, Comets, Gantert, and 
Zeitouni [2] the ergodic one-dimensional nearest-neighbor case, Yilmaz [24] the ergodic one-dimensional case 
with bounded step size, Zerner [25] the multi-dimensional product nestling case, and Varadhan [22] the 
general ergodic multidimensional case with bounded step size. Rosenbluth [17] gave a variational formula 
for the rate function in [22] . Level 2 quenched large deviations appeared in the work of Yilmaz [24] for the 
distributions P^{n~^ J2kZo ^Tx^ui,Zk+i G '}■ Here Zk = — Xk-i denotes the step of the walk. 

Our object of study, level 3 or process level large deviations concerns the empirical process 

ri-l 

Rlr = n-'j2^T..-^z,^^.^ (1-1) 

fc=0 

where Zk+i,oo = (^i)i>fc+i denotes the entire sequence of future steps. Quenched distributions Pq{R\'°° G ■} 
are probability measures on the space i (J7 x ^^) . This is the space of Borel probability measures on x 
endowed with the weak topology generated by bounded continuous functions. 

The levels do form a hierarchy: higher level LDPs can be projected down to give LDPs at lower levels. 
Such results are called contraction principles in large deviation theory. 

The main technical contribution of this work is the extension of a homogenization argument that proves 
the upper bound to the multivariate level 2 setting. This idea goes back to Kosygina, Rezakhanlou, and 
Varadhan [12] in the context of diffusions with random drift, and was used by both Rosenbluth [17] and 
Yilmaz [24] to prove their LDPs. 

Before turning to specialized assumptions and notation, here are some general conventions. Z+, Z_, and 
N denote, respectively, the set of non-negative, non-positive, and positive integers. | • ] denotes the ^°°-norm 
on R'^. {ei, . . . , Cd} is the canonical basis of R'^. In addition to Mi{X) for the space of probability measures 



Quenched LDP for RWRE 



3 



on X, wc write Q{X) for the set of Markov transition kernels on X. Our spaces are Polish and the cr-algebras 
Borel. Given fi G A4i{X) and q G Q{X), fi x q is the probability measure on X x X defined by 

fi X q{A X B) = J lAix)q{x, B) fj,{dx) 

and fiq is its second marginal. For a probability measure P, denotes the corresponding expectation 
operator. Occasionally P(/) may replace E^[f]. 

2. Main result 

Fix a dimension d > 1. Following are the hypotheses for the level 3 LDP. In Section 3 we refine these to 
state precisely what is used by different parts of the proof. 

^ is finite and 17 is a compact metric space. (2-1) 
Vx G Z"*, Elm G N and zi, . . . , G ^ such that a; = zi + h z^. (2.2) 

3p> d such that E[ |log7ro,z|^] < oo Vz G ^. (2.3) 

When 3i is finite the canonical $7 = V"^ is compact. The commonly used assumption of uniform ellipticity, 
namely the existence of n > such that IPIttq^j > ft} = 1 for z G ^ and ^ contains the 2d unit vectors, 
implies assumptions (2.2) and (2.3). 

We need notational apparatus for backward, forward, and bi-infinite paths. The increments of a bi- 
infinite path {xi)i^z in Z'' with = are denoted by Zi = Xi~ Xi^i. The sequences (xi) and (z,) are in 1-1 
correspondence. Segments of sequences are denoted by Zij = (z^, z^+i, • • ■ , zj), also for i = — cxd or j = oo, 
and also for random variables: Zij = (Zi, Zi^i, ■ ■ ■ ^ Zj). 

In general rjij denotes the pair (w, z^j), but when i and j are clear from the context we write simply 77. 
We will also sometimes abbreviate 7y_ = 77-00.0- The spaces to which elements 77 belong are fl- = fix , 
$7+ = fl X and fl = fl x Their relevant shift transformations are 

57 : ^ Jl_ : (a;,z_oo,o) (T^w, z_oo,o, 2), 
5+ : r2+ ^ $7+ ; (w,zi^oo) ^ (T^^w, Z2,oc.), 
S : n : (a;,z_oo,oo) 1-^ (T^^w, z_oo,oo), 

where Zi = z^+i. We use the same symbols 5*^, 5+, and S to act on z^oo,o, -zi.oo, and z_oo_oo in the same 
way. 

The empirical process (1.1) lives in $1+ but the rate function is best defined in terms of backward paths. 
Invariance allows us to pass conveniently between theses settings. If /i G A^i(Jl+) is S''''-invariant, it has a 
unique 5'-invariant extension p, on fJ. Let /i_ = /i|o_ ■ the restriction of p. to its marginal on There is a 
unique kernel q^ on fl that fixes (that is, fi-q^ = /i-) and satisfies 

g^(?7_, {57?7_ : z G ^}) = 1 for /z_-a.e. (2.4) 

Namely 

' ^zV- ) = = z\{uj, Z^ca.o) =V-}- 



(Uniqueness here is ^_-a.s.) Indeed, on the one hand, the above does leave invariant. On the other 
hand, if (7 is a kernel supported on shifts and leaves invariant, and if / is a bounded measurable function 
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on then 



J q{V-,S^ij-)f{ri^)fi{di-j) =Y^ J (?(r/_,5^,77_)/(T,'_3a;,z_oo,o)I{^' 

fiV-)Hzi = z}fl(d7]) 



z}y'-{dri-) 



The RWRE transition gives us the kernel p G Q(r2_) defined by 

p~{r]^,S~7]-) =7ro.3(a;), for 7y_ = (w,z_oo,o) G r2_. 

If Q 6 Q{^-) satisfies fj,^ x q fi^ x , then q{i]-, {S^rj^ : z G .^}) = 1 /^_-a.s. and their relative entropy 
is given by 



H{fi^ X g I /i_ X 



P~^= liV-^STV-) log '^i;^-'^-7-\ M_(rfr;_). (2.5) 



Let fj-o denote the marginal of /.j on SI. Our main theorem is the following. 

Theorem 2.1. Let (fi, 6,P, {TJ) be an ergodic system. Assume (2.1), (2.2), and (2.3). T/ien, /orP-a.e. oj, 
the large deviation principle holds for the laws Pq{R}^°° G •}, with rate function iJqucn : A^i(S^+) [0,oo] 
equal to the lower semicontinuous regularization of the convex function 

^ I H{fi^ X I X p^) if 1^1 is S'^ -invariant and /ig <^ P, 
I oo otherwise. 

We make next some observations about the rate function ffquen- 

Remark 2.1. As is often the case for process level LDPs, the rate function is affine. This follows because we 
can replace q^ with a "universal" kernel q whose definition is independent of ^. Namely, define 

f/ : 11_ ^ r2_ : (w,z_oo.o) ^ (r-zoi^, Z-oo.-i)- 

Then, on the event where lim„_j,oo ^ X]fe=o ^V'ri- exists define 



^ 1 

q{V-,S~i]-) = g^(7?^,5777_) for ^ = lim - ^6u'<:^_- (2.7) 

n— )-oo n. 

On the complement, set q{r]-,S~rj-) = (^^^(z), for some fixed zq G 

Remark 2.2. Let us also recall the convex analytic characterization of l.s.c. regularization. Let '^^(A') denote 
the space of bounded continuous functions on X. Given a function J : Mi{X) — > [0, oo], let J* : "lohiX) M 
be its convex conjugate defined by 

j*(/)= sup {E'^[f]-J{^l)} 

and let J** : A4i{X) ^ M be its convex biconjugate defined by 
J"(A*)= sup {E'^[f]-r{f)}. 

If J is convex and not identically infinite, J** is the same as its lower semicontinuous regularization Jisc; see 
Propositions 3.3 and 4.1 of [8] or Theorem 5.18 of [15]. Thus the rate function in Theorem 2.1 is -ffquon = H** . 



Quenched LDP for RWRE 



5 



As expected, rate function H has in fact an alternative representation as a specific relative entropy. For 
a probability measure u on fJ, define the probability measure v x Pq on r2+ by 

fd{vxP^) = [ \ f f{u:,zi,^)P^{dz^,^) \ iy{dLo). 

On any of the product spaces of environments and paths, define the cr-algebras Qr,i,n = crjo;, Zm^n}. Let 
Hg^ ^ (a I /3) denote the relative entropy of the restrictions of the probability measures a and /3 to the a- 
algebra Gm.n- Let 11 be the kernel of the environment chain (Tx„w), defined as Ilf{uj) = £'g [/(Txiw)] = 

Lemma 2.2. Let /i G A^i(rj+) be S'^ -invariant. Then the limit 

h{fi I ^0 X ^'o ) = lim -Hg^ ^{fi\fioX ) (2.8) 

)i— >c>o n ' 

exists and equals H{fi^ x \ x p^). 

Proof. Fix II. Let /J."'^^ '"^ (■) denote the conditional distribution of Zi under n, given Then by the 

S'-invariance, 

jl[Zl =M|^2-t,o] (1^,22-1.0) =/^f"'"'"'^^ ''"(u)- 

For 1 = 1 we must interpret = cr{uj} = & and (w, zi,o) simply as w. Observe also that the conditional 
distribution of Zi under /io x , given Gi,i-i, is 7ro,.(T2;._jw). 

By two applications of the conditional entropy formula (Lemma 10.3 of [21] or Exercise 6.14 of [15]), 



n p 

^Gi,„(mIa*o X ^0) =X] / ^{l^t 1 7ro,.(r^,_ia;)) /i(da;,dzi_oo) 

i — 1 

n „ 
n „ 

= X] / ^(a^I^i ^ ■ I 02-i,o](^,^2-i,o) 1 7ro,.(a;)) fi-{duj,dz_ao,o) 

i—l 
n 



(2.9) 



As fc — > 00, the (T-algebras Q^k,i generate the cr-algebra G-00.1 = ctIo;, and consequently 

^e2-i,i(/^- ^ ^A' I X p") i7(^_ X I ^_ X p") as i 00. (2-10) 

We have taken some liberties with notation and regarded /i_ x q^ and /i_ xp~ as measures on the variables 
(a;,z_oo,i)j instead of on pairs {{uj, z^ao.o)A^' t ^'-00 o))- This is legitimate because the simple structure of 
the kernels and p~, namely (2.4) implies that z'_^ q = z-00,1 and oj' = Tz^oj almost surely under these 
measures. 

The claim follows by dividing through (2.9) by n and letting n — !> 00. □ 

Note that the specific entropy in (2.8) is not an entropy between two S'"''-invariant measures unless /zo is 
Il-invariant. The next lemma exploits the previous one to say something about the zeros of Hqucn- 

Lemma 2.3. //-ffqucn(M) = then fi(duj, dzi^oo) — Mo(c^'^)^'o'(c'^i,oo) for some Il-invariant /iq. 
Note that it is not necessarily true that /do in the above lemma. 
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Remark 2.3. One can show that under (2.1) and (2.2) there is at most one Poo G J^i{ft) that is H-invariant 
and such that Poo <C P; see for example [13]. In fact, in this case Poo ^ P. The above lemma shows that the 
zeros of -ffqucn consist of Pq°° = Poo X Pq (if Poo ^ P exists) and possibly measures of the form x Pq , 
with fia being H-invariant but such that /io P- 

Proof. There is a sequence of S'^-invariant probability measures /i^™) — > n such that H{ii'^'''^) and 
< P. (If /^o < P then we can take /x'™-' ~ /x.) Let /^^ denote the marginal distribution on (a;, 2;— oo,i) 
which can be identified with /i'^-' x q^im) and converges to the corresponding marginal /ii. By the continuity 

of the kernel t:q,z{'^), A*'-"'' x — > /i_ x . From these limits and the lower semicontinuity of relative 
entropy, 

if (//I I /i_ X p-) = lim i?(A4"^ I M-"' X p-) = 0. 

This tells us that /i_ is p~-invariant, which in turn implies that /ig is H-invariant, and together with the 
S'^-invariance of /i implies also that fi ~ x P^ . (The last point can also be seen from (2.9) and (2.10).) □ 

We close this section with some examples. 

Let V, = with V — {{pz)z£3i G (0, 1)'^ : X^zP^ ~ ^l- ^ ^ ^+ ^"0 the law of a classical random 
walk; i.e. v = vq x with = S^^ , for some a Then H{v^ x q^\v^ x p) =0. However, if zuz 
is not in the set J\f = : i?quGn(M) = O}' then, iJquon('^) > 0. Note that by the contraction principle, 

Af is the zero set of the level-1 rate function. Hence if P is product, by [22] Af consists of a singleton or a 
line segment. Thus we can pick a so that the mean ^ zaz does not lie in Af, and consequently we have 
measures ly for which -ffqucn(j^) > = H{v^ x q^]^^ x That is, the rate iiqucn does not have to pick 
up the entropy value. 

Lower semicontinuity of relative entropy implies -ffqucn(M) ^ when /ig <C P. This equality can still 

happen when fiQ <^ P; i.e. the l.s.c. regularization can bring the rate -ffqucn down from infinity all the way 
to the entropy. Here is a somewhat singular example. Assume P{7ro^o(a;) > 0} = 1 and let C = (0, 0, 0, ... ) 
be the constant sequence of 0-steps in Z''. For each w G define the (trivially S'+-invariant) probability 
measure z^" = on Then, for all ui in the (minimal closed) support of P, 

iiquon(i'") = H{iy^ X I ly^ X p-) = - log^o.o(t:^). (2.11) 

The case 7ro.o('^) = is allowed here, which can of course happen if uniform cUipticity is not assumed. 

The second equality in (2.11) is clear from definitions, because the kernel is trivial: q^i^ (77-, 7y_) = 1. Since 
-ffquon('^") is defined by l.s.c. regularization and entropy itself is l.s.c, entropy always gives a lower bound 
for i/qucn- If > then = Ss, and the first equality in (2.11) is true by definition. If ¥{ui} = 

pick a sequence of open neighborhoods Gj \ w. The assumption that uj lies in the support of P implies 
P{Gj) > 0. Define a sequence of approximating measures by 11^ — Jq. J^"P((ia;) with entropies 

H{fi' X q^, xp-) = -^^7^ / log7ro,o(w)P(dw). 

'^['^3) JGj 

The above entropies converge to — log ttq.o (<^) by continuity of 7ro,o(-)- We have verified (2.11). 
3. Multivariate level 2 and setting the stage for the proofs 

The assumptions made for the main result are the union of all the assumptions used in this paper. To 
facilitate future work, we next list the difi^erent assumption that are needed for different parts of the proof. 

The lower bounds in Theorem 2.1 above and Theorem 3.1 below do not require f2 compact nor 1% finite. 
They hold under the assumption that P is crgodic for {Tz : z G ^} and the following two conditions are 
satisfied. 



Ht^o,z > 0} G {0, 1} for aU z G Z'^. 



(3.1) 
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Either E[| logTTo^zl] < oo holds for all z G ^ or there exists a 
probabihty measure P^o on {ft, &) with Pooli = Poo and P^c- < P- 

Note that (3.1) is a regularity condition that says that either all environments allow the move or all prohibit 
it. 

Our proof of the upper bound uses stricter assumptions. The upper bound holds if P is ergodic for 
{Tz : z £ Si is finite, J7 is compact, the moment assumption (2.3) holds, and 

Vx G ^, Elm e N, 3zi, . . . , z,„ G ^ such that a; + zi H h = 0. (3.3) 

On its own, (3.3) is weaker than (2.2). However, since the additive group generated by ^ is isomorphic to 
Z"^ for some d! < d, we always assume, without any loss of generality, that 

Z'' is the smallest additive group containing SI. (3-4) 

Then, under (3.4), (3.3) is equivalent to (2.2). 

The only place where the condition p > d (in (2.3)) is needed is for Lemma 5.1 to hold. See Remark 5.3. 
The only place where (2.2) (or (3.3)) is needed is in the proof of (5.6) in Lemma 5.5. This is the only reason 
that our result does not cover the so-called forbidden direction case. A particularly interesting special case 
is the space-time, or dynamic, environment; i.e. when Si G {z : z ■ ei = 1}. A level 1 quenched LDP can 
be proved for space-time RWRE through the subadditive ergodic theorem, as was done for elliptic walks 
in [22]. Yilmaz [23] has shown that for i.i.d. space-time RWRE in 4 and higher dimensions the quenched 
and averaged level 1 rate functions coincide in a neighborhood of the limit velocity. In contrast with large 
deviations, the functional central limit theorem of i.i.d. space-time RWRE is completely understood; see 
[14], and also [1] for a different proof for steps that have exponential tails. 

Next we turn to the strategy of the proof of Theorem 2.1. The process level LDP comes by the familiar 
projective limit argument from large deviation theory. The intermediate steps are multivariate quenched 
level 2 LDPs. For each ^ G N define the multivariate empirical measure 



= 



This empirical measure lives on the space $7^ = J7 x S?^ whose generic element is now denoted by = (w, zij). 

We can treat as the position level (level 2) empirical measure of a Feller-continuous Markov chain. 
Denote by (with expectation E^) the law of the Markov chain (r]k)k>o on Cli with initial state r/ and 
transition kernel 

p+(7?, S'+jy) = Trx^^a:e+zi^^) = Tro,ziTx,uj), for ri = (cj,zi_f) G Jl^, 

where 

5+ : n^-^ne : {uj,zij) {T^^u, Z2,e, z). 
This Markov chain has empirical measure 



n-l 

Vk 



k=0 



that satisfies the following LDP. Define an entropy Hi on Aii{ne) by 

iM{H{nxq\nxp+): qeQ{ni) with ^lq^^l} if < P, 

He[N = < .u • '■"^-^^ 

CXD otherwise. 



Hi is convex by an argument used below at the end of Section 4. Recall Remark 2.2 about l.s.c. regularization. 
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Theorem 3.1. Same assumptions as in Theorem 2.1. For any fixed t > 1, forV-a.e. u, and for all zu G , 
the large deviation principle holds for the sequence of probability measures P^{i„ e •} on A^i(Of) with 
convex rate function H^* . 

The lower bound in Theorem 3.1 fohows from a change of measure and the ergodic theorem, and hints 
at the correct rate function. Donskcr and Varadhan's [6] general Markov chain argument gives the upper 
bound but without the absolute continuity restriction in (3.5). Thus the main issue is to deal with the case 
when the rate is infinite. This is nontrivial because the set of measures with /io ^ P is dense in the set of 
probability measures with the same support as P. This is where the homogenization argument from [12], 
[17] and [24] comes in. 

We conclude this section with a lemma that contains the projective limit step. 

Lemma 3.2. Assume P e A4i{fl) is invariant for the shifts {Tj, : z G ^} and satisfies the regularity 
assumption (3.1). Assume that for each fixed £ > I there exists a rate function li : M.i{'D.t) — > [0, oo] that 
governs the large deviation lower bound for the laws Pri{Ln £ ■}, for ¥- almost- every lu and all zij G 
Then, for P-a.e. ui, the large deviation lower bound holds for Pq {Rl^°° G ■} with rate function I(p) = 
suPc>i Ie{li\ni), for n G Mi{n+). 

When M is finite and Q is compact the same statement holds for the upper bound and the large deviation 
principle. 

Proof. Observe first that P,, is the law of {Tx^uj, Zk+i,k+i)k>Q under Pq, conditioned on = zi.^. Since 
Pq{Zi^i = zi^i} > P-a.s. we have for ah open sets O C Mijfti), 

lim log P^{R'/ G 0} > lim n'' log \p^{Z,j = z.^^jPoiRY e O \ Z,j = z,j} 

n—>oo n— >-oci 

= lim 71-1 iogp^{jiy g Q I z^^^ ^ J > _ ij^f 

Similarly, in the case of the upper bound, and when ^ is finite, we have for all closed sets C C 
lim n-^ log P^{Rl;'^ G C} < lim max n'^ logPo"{i?,J/ G C \ Zij = zi,^} 



< max lim n"^ log Po"{P,J,'^ G C \ Zi^e = zi,^} 

' n— >-oo 



< -inf /£. 

c 

We conclude that conditioning is immaterial and, P-a.s., the laws of i?^'^ induced by Pq satisfy a large 
deviation lower (resp. upper) bound governed by Ig. The lemma now follows from the Dawson-Gartner 
projective limit theorem (see Theorem 4.6.1 in [3]). □ 

The next two sections prove Theorem 3.1: lower bound in Section 4 and upper bound in Section 5. Section 
6 finishes the proof of the main theorem 2.1. 



4. Lovirer bound 



We now prove the large deviation lower bound in Theorem 3.1. This section is valid for a general ^ that 
can be infinite and a general Polish fl. Lemmas 4.1 and 4.2 are valid under (3.1) only while the lower bound 
proof also requires (3.2). Recall that assumption (3.4) entails no loss of generality. 

We start with some ergodicity properties of the measures involved in the definition of the function Hi. 
Recall that = x and that for a measure /i G A4i{^li), fiQ is its marginal on fl. Denote by Pq^^ the 
law of (w, Zi i) under Pq. 

Lemma 4.1. Let (Jl, (3, P, {Tz}) be ergodic and assume (3.1) and (3.4) hold. Fix £ > 1 and let ^ G J^i{Q,i) 
be such that fj, <^ Pq^' . Let q be a Markov transition kernel on fli such that 
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(a) ^ is q-invariant (i.e. fiq ~ ii); 

(b) q{ri, Sfi]) > for all z E ^ and /i-a.e. r] G flf ; 

Then, /i ^ Pq^' and the Markov chain {rik)k>Q on fli with kernel q and initial distribution fj. is ergodic. In 
particular, we have for all F S L^{^j) 

lim n^^ V E^^^ [F{7]k)] = E'^lF], for fi-a.e. jj. (4.1) 

k=0 

Here, Qn is the Markov chain with transition kernel q and initial state rj. 

Proof. First, let us prove mutual absolute continuity. Let / = — Then, by assumptions (a) and (c), 
= / I{/ = 0}/dFo<'' ^ f l{f = 0}dfi=J2 [ liv, StvMfiStv) = 0}/i(d7?). 

By assumption (b) , this implies that for z 6 ^ 

= / I{/(5+?7) = 0}M(d77) = / HfiStv) = 0}firj)P^'\d7j). 



By regularity (3.1) we conclude that I{/(r/) > 0} < lI{/(5+7?) > 0}, for all z G ^, zi,^ G M\ and P-a.e. w. 

By first following the path Zi^e, then taking an increment of z G then following a path zi_£ G i^^, one 
sees that for all zi^£, zi^i G ah z G and P-a.e. w, 

I{/(w, zi,,) > 0} < I{/(r,,+,w, 5i,f) > 0}. (4.2) 

Now pick a finite subset zi, . . . , zm G ^ that generates Z"^ as an additive group; e.g. take the elements 
needed for generating the canonical basis ei,...,ed. Note that M > d can happen; e.g. take d = 1 and 
^= {2,5}. 

Applying (4.2) repeatedly, one can arrange for z to be any point of the form X]f=i ^i^i with ki G Z+. 
Furthermore, the ergodicity of P under shifts {Tz} implies its ergodicity under shifts {Tz^, . . . ^Ti,,,}, since 
the latter generate the former. We can thus average over k = (ki, kM) S [0,n]*^, take n — ^ cxo, and 
invoke the multidimensional ergodic theorem (see for example Appendix 14. A of [9]). This shows that for 
all zi.f , zi^g G and P-a.e. a; 

I{/(w, zij) > 0} < P{w : f{uj, > 0}. 

Since / integrates to 1 there exists a zi^^ G with F{f{uj, zi^g) > 0} > 0. This implies that V{f{uj, zi^i) > 
0} = 1 for all Si,e G and hence fi - P^'^\ 

Next, we address the ergodicity issue. By Corollary 2 of Section IV. 2 of [16], we have that for any 
F G L^{lj) and fi-a..e. 77 G fii, 

n— 1 

hm -Y,EQ-[F{Vk)] = E'^[F\I,,,]. 

n^oo ri ^ — ^ 
fc=0 

Here, I^^g is the cr-algebra of q-invariant sets: 



A measurable : 



g(77,A)I^c(7y)/i(d7?) = / q(77,A^)lI^(77)Ai(d?7) =0}. 
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Ergodicity would thus follow from showing that I^^q is /i-trivial. To this end, let A be I^^g-measurable. By 
assumptions (b) and (c) and mutual absolute continuity we have that for all z 6 ^ 



Replacing the set {/ > 0} by A'^, in the above proof of mutual absolute continuity, one concludes that 
Plf\A) S {0, 1}. The same holds under /i and the lemma is proved. □ 

We are now ready to derive the lower bound. We first prove a slightly weaker version. 

Lemma 4.2. Let (fi, 6, P, {T^}) be ergodic and assume (3.1) and (3.4) hold. Fix I > 1. Then, for¥-a.e. ui, 
for all zij G , and for any open set O C 



lim n ^ log Pn{Ln e 0} 

n— >oo 

> - inf |i7(^ X q\^ X p+) : fi e O, fiQ qe Q{fle), pq = fi, 

and Vz G q{7'/,S^7'/) > 0, /Lt-a.s.|. 



Proof. Fix p ^ O and q as in the above display. We can also assume that H{ii x q \ p x p+) < oo. Then 
q{ri, {S^rj : z G ^}) = 1 /i-a.s. We can find a weak neighborhood such that p ^ B C O. That is, we can find 
£ > 0, a positive integer m, and bounded continuous functions fk : fi^ — >■ R, such that 

B = {iye MiiUe) ■.yk<m, {E-'ifk] - E^[fk]\ < e}. 

Let J^n be the ct- algebra generated hy rjQ, ... ,r]n- Recall that Q,, is the law of the Markov chain with initial 
state rj and transition kernel q. Then 



"MogP„{i„ eO}> 71-1 iogP„{L„ e B} 



> n ^ log ■ 



Qr,{i„ e B} 

(by Jensen's inequality, applied to log x) 

'dQr,, 



-1 log Q„{L„ e B} 



1 e'^-^ 



> 



Qn{Ln e B} 



log 



dQn, 



n HogQr,{Ln e B} 

<iQv I 



log 



dP„ 



Q„{i„ e B) 



Qr,{Ln e B} 



logQ^{L„ e B} 







n.-'^E,-! 


Qn{Ln e B} 



dQr, 



dPr,\.9^„_, 



^log 



dQr,, 



dP-n 



> 









Qr,{i„ G B} 


Qr,{i„ G B} 



Qn{Ln G 5} 
n-ilogO,,{L„ e B}. 



log Q^{Ln G S} 



In the last inequality we used xloga; > — e i. Observe next that fj, and g satisfy the assumptions of Lemma 
4.1. Thus, Qn{Ln G i?} converges to 1 for /i-a.e. 77. Furthermore, if we define 

9(?7, S+iq) 



P^'n) = 9('7, Stv) log ' ^, > 0, (by Jensen's inequality) 

_p+(?7,5'J?7) 
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then E^^\F] = H{iJ, x g | x p+) < oo and (4.1) implies that for /i-a.e. r] 

= lim E'^" 
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hm n 

n— J-ctt 



^E^'[F]^H{|lXq\^lxp+). 



k=0 



We have thus shown that 

lim log P,f{L„ e 0} > -H{^ x q\iJ.X p+) 

n— >oo 

for ^-a.e. rj. By Lemma 4.1, this is also true Pq -a.s. 



□ 



To prove the lower bound in Theorem 3.1 we next need to remove the positivity restriction on q. This is 
a simple consequence of convexity. 

Proof of the lower bound in Theorem 3.1. Recall our assumption (3.2). If an invariant measure Poo 
exists, then let q = p+ and fi{du},dzi^e) = Voo{duj)PQ {dxoj)- If, alternatively, E[| logTro,^!] < oo, for all 
z £ then set tt^ — ce^l^l/(E[| log7ro,^|] V 1), where c is chosen so that 'J2ze^''^^ ~ ^- This ensures that 



loe 



< OO. 



In this case, define jl{dui, dzi/ 

7T^. Let g(?7, Sflf) = TTz- 



])P{dzi^i), where P is an i.i.d. probability measure with P{Zi = z} 



Observe that in either case, /t ^o^^ A? = ^^'^ x q \ jj, x p+) < oo. 



Let fi £ O he such that /ig <C P. By (3.1), /i <^ Pq'' ■ Let q be such that /i is g-invariant and i?(/i x q\^x 



p^) < oo. 



Fix e e (0, 1) and define /i^ = e/i + (1 — £)/i. For e > small enough, this measure belongs to the open set 
O. It is also clear that fi^ < P^^\ Let A = ^ and Note that Lemma 4.1 implies that jl ~ Pq^^ 

Thus, /i ^ /ie and Peife > 0} = 1. Next, define the kernel 

Qeiv, Stv) = £fe{ri)q{v, Stv) + (1 - £)fe{v)Q{v, Stv)- 
Then, /^^-a.s., X^ze^? '^^^) ~ 1 ^^"^ '?e(^i '^'aT^) > for aU -z G Furthermore, Heqe — ^J^e■ Indeed, 

[ Gistv)[efeiv)qiv,stv) + ii-£)feiv)qiv,stv)]f^e{dO 

= eJ2 [ GiStvMv, StilMdv) + (1 - e) ^ / G{Str,)q{rt, Stv)Kdv) 

= e j Gdfi + il-e) J Gdfi^ J Gdfi,. 
On the other hand, Jensen's inequality (applied to x log a;) implies 



H{pe xq^\^i^xp+) = Y^ / q^{ri, S+rj) log 

z 

<T.J ^/^(^) ^(^^ ^tri) log ^^j^^^ Me(d^) +T.J(^- liv, Stv) log 



e Y: I qiv, Stv) log Kdv) + (1 - E / '?(^' S^^) 

^7 P+ (77, 5*777) p+{t], 

eH{fj, X q \ fl X p+) + (1 — s)H{p X q\fi X p+). 



9(^.5+77) 
p+(?7, S'^r7) 



tJ-e{dri) 



Str,) 
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Since H[jl X q \ fi X p+) < oo, applying Lemma 4.2 and then taking e — > proves the lower bound in 
Theorem 3.1 with function Hi. The argument above can also be used to show that Hg is convex. Thus the 
lower bound also holds with Ht* . □ 



5. Upper bound 

To motivate the complicated upper bound proof we first present a simple version of it that works for a finite 
f2, which is the case of a periodic environment. In this case, the upper bound only requires the regularity 
assumption (3.1). Note also that the finiteness of il implies the existence of V^o as in assumption (3.2), and 
hence the lower bound (and, consequently, the large deviation principle) also holds under only (3.1). 
Fix i > 1. Given bounded continuous functions h and / on define 



Kt,h{f ) = P-css supsuplog^p+(7y, 5+ry) 

UJ Zip 

z 

Define Kg : -> R by 

Kfif)= inf Kg^hif). 

/iG%(f2«) 

A small modification of Donsker and Varadhan's argument in [6], given below in Lemma 5.2, shows that for 
P-a.e. u! and all zi^g G one has, for all compact sets C C A4i{fli), 

li^ n-^logPjLn eC} <- inf K}{fi), 

where K^{i-l) = s^Y> f £'^^{n-){^^[I] ^ Kiif)} is the convex conjugate oi Kj. Now we observe what it takes 
to turn this rate function into H^* and thereby match the upper and lower bounds. 
First 



M-iif) ~ inf P-ess supsuplog^p^(77, 5'^?7)e 



f(n)-h(r,) + hiStri) 

jj. v-ukj kjuifj '-"-^K ^-^JS / h' V'/l'-'r '//^ 



(5.1) 

= inf sup {E^lf]- El" [h^ log p+{e'')]}. 

On the other hand, given fiyiy G A^i(17£), we have this variational formula: 

M{H{a\aiXp+):aeMi{nj),ai^H,a2=iy}= sup {E^lh] - E^'[logp+ {e'')]}, 

where ai and a2 are the first and second marginals of a (see Theorem 2.1 of [7], Lemma 2.19 of [19], or 
Theorem 13.1 of [15]). Out of this we get 



H;{f)^ sup {E^[f]-M{H{^ixq\fixp+):tiq = ti}} 

= sup lE'^lf]— inf {H{a\ai X p^) : ai ~ a2 ^ 

M:Mo<P ^ aeMi(nj) J 

= sup |£;^[/]- sup Et'lh - log p+{e'')]\ 

= sup inf {i?^[/]-i?^[/i-logp+(e'')]}. (5.2) 

Comparison of (5.1) and (5.2) shows that matching and H^, and thereby completing the upper bound 
of Theorem 3.1, boils down to an application of a minimax theorem (such as Konig's theorem, see [11] or 
[15]). However, the set {/x : /Xq ^ P} is compact if, and only if, P has finite support. 
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To get around this difficulty we abandon tlie attempt to prove tlie equality of and . Instead, we 
redefine -K^ by taking infimum over a larger set of funetions. This decreases and makes it possible to 
prove > K_^. We will still be able to prove that i/^ < and that K*^ governs the large deviation upper 
bound. The new definition extends the class of functions to include weak limits of hk{S^vi) — hk{ri), which 
may lose this form. Such limits are the so-called "corrector functions" , familiar from quenched central limit 
theorems for random walk in random environment (see for example [14] and the references therein). Let us 
introduce this class of functions and redefine K^. 

Definition 5.1. A measurable function : $1^ x ^ ^ R is in class ICp{S},£ x ^) if it satisfies the following 
three conditions 

(i) Moment: for each zij, e and z G ^, E[|F(a;, zi^i, z)\p] < oo. 

(ii) Mean zero: for all n > ^ and {aiY^L^ € the following holds. If ?/o ~ i^, an-£+i,n) and rji = S^.rji-i 
for i — 1, . . . , n, then 

n-1 
i=0 

In other words, expectation vanishes whenever the sequence of moves 5+ , . . . , 5*+^ takes {oj, zi.f) to 
{TxOJ, Zi^e) for all w, for fixed x and zi,£. 

(iii) Closed loop: for P-a.e. u and any two paths {ryi}"^g and {fjj}"^Q with j]o — fjo ~ (w,2:i,f), r]n = fjm, 
r]i = 5*+ and fjj ~ S^.fjj-i, for i,j > and some {ai}"^^ S and {aj}"^^ g we have 

n — 1 m— 1 

^F(?7,,a,+i) = F{fjj,aj+i). 

i=0 j=0 

Remark 5.1. In (iii) above, if one has a loop (rjQ ~ rjn), then one can take m = and the right-hand side in 
the above display vanishes. 

Remark 5.2. Note that functions F{ri,z) ~ /i(5+r/) — /i(ry) belong to this class. 

The following sublinear growth property is crucial. We postpone its proof to the appendix. 

Lemma 5.1. Let (17, (5, P, {Tz}) be ergodic. Assume P satisfies assumptions (2.1) and (3.4). Let F G 
lCP{n( X ^) with p > d being the same as in assumption (2.3). Then, for P-a.e. co 



limn ^ sup sup ^(77^, afc+i) 

zi,fe«* (ai,...,a„)fE^" I ^ 

r;o = ((^ , z 1 , f ) , i = 5+ r/i _ 1 



= 0. 



Remark 5.3. The above lemma clarifies why the method we use requires the condition p > d. Indeed, consider 
the case i^O,n = P^ , P a product measure, and -^(0;, z) = h(TzLo) — h{uj) with h being a function of just 
Wo- Then, the conclusion of the lemma is that n^^ sup|^|<„ |/i(a;a;)| vanishes at the limit. For this to happen 
one needs more than d moments for h. 

Now, for F e /CP (Of x ^) and / G %ine), redefine 

Ke^Fif) =P-ess supsuplog^p+(77, 5+?7)e^('')+^(''^^). 

z 

Redefine Kj, : %{ne) R by 

K,{f)= inf K,.p{f). 
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Lemma 5.2. Assume the conclusion of Lemma 5.1 holds. ForP-a.e. uj and all zi^i, for all compact sets 

li^ logP„{L„ eC}<- inf K^{fi), 
where = ^'^Y>f^^^{ni){-^^[.f\ ^ iLeif)} convex conjugate of Kg. 

Proof. Fix ^ G C and c < inf c . There exist f <E '^b i^e) and F e ICp (fJ^ x^) such that E^' [/] - A'^^f (/) > 
c. Fix e > and define the neighborhood 

B.i^i) = {ue Mii^le) : lE-'if] - < e}. 

Lemma 5.f imphes that for P-a.e. ui there exists a finite c^{uj) > such that for aU n and zi^i S 

n-l 



F{rik,Zk+i+i) > -Ce - ne, P^-a.s. 



fc=0 



Therefore, for all zi.^ G and P-a.e. w, 



cxp • 



A:=0 

1 

n-l 

«^p{E (/fe)+^fe,^fc+^+i))} 

n-2 



E. 



rji : i < n — 1 



,/('?o)+F(,7o.Zj+i)i 



fc=0 



n-2 

cxp{^(/(r,,)+P(77fc,Zfc+,+i))} 

fc=0 



□ 



< . . . < gCe+"e g-n-E^[/]gne ^nKi^pif) ^ gCj+2ne-cn 

Since C is compact, it can be covered by a finite collection of Be(/i,;)'s and 
iW n"^ logP,{L„ G C} < -c+ 2£. 

n— J-ctt 

Thus, taking e — > and c to infc A^ proves the lemma for a compact C. 

Our next theorem gives the connection between Kj and Hg. 
Theorem 5.3. Same assumptions as in Theorem 3.1. Then, Hf = K_g for all £ > 1. 
We are now ready to prove the above theorem and finish the proof of Theorem 3.1. 

Proof of Theorem 5.3 and the upper bound in Theorem 3.1. It suffices to prove that for bounded 
continuous functions /, 



Kfif) < Hlif) = sup{ii;'^[/] - hKm)}- 



(5.3) 
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Indeed, this would imply that iJ^* < K^^ and Lemma 5.2 implies then the upper bound in Theorem 3.1. 
Furthermore, due to the lower bound and the uniqueness of the rate funetion (see Theorem 2.18 of [15]), 
we in faet have that H^* = IQ. This implies that H'^ = K^* and since is convex and continuous in the 
uniform norm, we have that = K^. 

Let us now prove (5.3). This is trivial when H^{f) = oo. Assume thus that H^{f) < oo. 

Let &k be an increasing sequence of finite cr-algebras on fl, generating &. Assume that for all fc > 1 and 
y e M, Ty&k-i C &k- Let Mi = Mii^le) be the set of probability measures ^ on Ui such that no ^ ¥ 
and is ©fe-measurable. Now write 

HKf) = sup - Heifi)} > sup {E^^lf] - He{fi)}. 

To conclude the proof of (5.3), one invokes the following lemma. 

Lemma 5.4. Same assumptions as in Theorem 3.1. Fix £ > 1 and let f S '^^(Jlf) and A < oo be such that 
A> sup {E^[f]-Hi{^l)}, 

for allk>l. Then, A > Kf{f). 

Proof of Lemma 5.4. Let AA'I''^ be the set of probability measures a on ft'j such that the first n^-marginal 
ai e A4i. Observe next that if a G A4i{flf) is such that ai ^ a-i, then 

inf {E°'^\h\ - E°'^\h\\ = -oo. 



Write 



A > sup^ [E^[f] - inf{F(Ai xq\iixp+): pq = ^t}} 



= sup{£;"i[/] - ff(a|ai x p+) : a G M\'^,ai =03} 

> sup inf [E°'^[f]+E°'^[h]-E°'^[h]-H{a\aiXp+)\. 

Since the quantity in braces is linear (and hence continuous and convex) in h and concave and upper 
semicontinuous in a, and since M^'^ is compact, we can apply Konig's minimax theorem; see [11]. Then 



A> inf sup iE°'^[f]+E°'^[h]-E'^^[h]-H{a\aiXp+)\ 
/le'lsfbfn,) ^ , .fc,2 L J 



inf sup sup 



f{ri) + qh{T^) -h(i^)- H{q{rj, ■)\p+ (r,, ■)) ^dv) 



= inf sup E>^[f~h + \ogp+{e'^)] 

> inf sup sup lE'^lf — h + logp+(e'')] : p = I-Iq O Sz, and is &k measurable}. 
/te%(r!f)2j_,g^f L ■ d¥ i 

In the last equality above we passed the sup under the integral, since the integrand is a function of 9(77, •) and 
one can maximize for each 77 separately. Then we used the variational characterization of relative entropy; 
see Lemma 10.1 in [21] or Theorem 6.7 in [15]. We thus have 

A> inf sup P-ess supE[/ - /i + logp+(e'') I 6fc] 



inf sup P-ess supE 



f{v)-Hv)+HS+v) 



6k 
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Let ly e Aii(^) with i/{z) > for all z G Write the last conditional expectation as 



E 



[log^j.(z)exp{log[i.(z)-V(^,5^^?)] + /('?) - Hv) + h{Stv)} 



An application of an infinite-dimensional version of Jensen's inequality (see Lemma A.l) and cancelling the 
i^(z)-factors gives 

A> inf sup P-csssup(logye=['°sf+('''^J")+^('')-'^('')+''(^^'')l®'=l|. 

The above means that for e > and k > I there exists a bounded continuous function h^ g such that for 
all zi,e G ^'^ and P-a.s. 

A + e> log^e'^l^('')+'°SP+('):Str,)-ftfc,,('7)+'ifc,.(Str,) |6fc] _ ^5_4) 
z 

Next, wc show that the sequence 

Fk,e{v,z) = E[hk^,{Stv) - hkAv) I (5.5) 

is uniformly bounded in LP(P), for any fixed zi,i and z. Hence, along a subsequence, Fk.e converges in the 
LP{F) weak topology to some G L^'(P). Wc can in fact use the same subsequence for all zi.^ and z. We 
will still call this subsequence One can also directly check that F^ G }CP{fli x .^). In order not to 

interrupt the flow wc postpone the proof of these two facts to Lemma 5.5 below. 
On the other hand, 

Mkiv, z) = E[/(7?) + logp+(77, 5+77) I &u-i] 

is a martingale whose LP(P)-norm is uniformly bounded. It thus converges in LP(P) (as well as almost-surely) 
to /(7/)+logp+(?7, S^ij), for all zi^i and z. Thus, by Theorem 3.13 of [18], for each fixed zi,e and z, there exists 
a sequence of random variables gk.eij], z) that converges strongly in (and thus a subsequence converges 
P-a.s.) to f{rj) + logp+(?7, S'^rf) + i^e(?7, z) and such that gk.e is a convex combination of {Mj + Fjj, : j < k}. 
One can then extract a further subsequence that converges P-a.s. for all zi/ and z. 
By Jensen's inequality, we have for all zi^i G and P-a.s. 



gMfc(i7,z) + Ffc.,(i7,z)^ 



Since this is valid for all fc > 1, another application of Jensen's inequality gives 



Taking fc — !■ cx) implies, for P-a.c. to and all z\^i G . 

A + £ > /(r?) + log ^ p+ (77, 5+77)e^=('''^) 

z^m 

and thus 



A^£> inf sup P-ess sup (/(?7)-h log Vp+ (77,5+ 77)e^('''^)|. 



Taking e — > proves that A > K_^. □ 
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Lemma 5.5. Assume (17, 6, P, {T^}) is ergodic. Assume P satisfies assumptions (2.1), (2.2), and (2.3). 

Then, for £ > 0, £ Si^ , and z £M, 



SUpE[|Ffc,e(cj,Zi,^,z)|P] < OO. 
k 



(5.6) 



Moreover, if a subsequence converges {in weak (¥) -topology) , for each Zi ( and z, to a limit F^, then 
belongs to class IC^i^li x ^). 

Proof. Since / is bounded (5.4) implies that for P-a.e. uj and for all zi,£ S 

FkAv.z) <C- E[logp+(77,^+77) I &k-i]. 

The LP(P)-norm of the right-hand-side is bounded by C + log7ro,z|^], whieh is finite by assumption (2.3). 

By assumption (2.2), there exist ai, . . . , Om S ^ such that xi + z+ai + - ■ ■+am-i = and am_£+i,„i = zi^i. 
Then, letting rjo = 5"+ 77 and 77^+1 = S'^.^^rji and defining (y^, z\ ^) such that = {Ty.uj, zl g), < i < m — 1, 
we have 

m — 1 



1=0 
m—1 

771—1 

= ^ E[/ifc.e(5i^, (^, 4,^)) - /^A^e(c^, 4,,) I Gk] o 

771—1 

1=0 

The last inequality is a result of (5.4). Taking conditional expectations given &k-i one has 
-Fk^r^, z) - E[/ife,,(77) - huAStv) I ©fc^i] 

m—1 



?n — 1 



i=0 



6 



fc-i 



m—1 



< C m - ^ E [E[logp+((c., z^,), 5+^^ (l., z^,,)) | 6^] o T,, 

4=0 



©fc-1 



The LP(P)-norm of the right-hand-side is bounded by (C -I- E[| logTTo 2|^])7Ti, which is finite by assumption 
(2.3). 

Consider next a weakly convergent subsequence. We will still denote it by Fk^e- Let F^ be its limit. Clearly, 
G LP(P) and the moment condition (i) in Definition 5.1 is satisfied. Also, since the mean zero property 

(ii), in Definition 5.1, is satisfied for each Fk^ei it is satisfied for F^. 

Furthermore, weak convergence in L^'(P) and finiteness of the cr-algebras &j imply that for any fixed j, 

¥\Fk,e I ©j] converges to E[F£ | &j\ for every zij G 3?/ and P-a.e. lo. Since the closed loop property holds for 
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every Fk_e, we have that for any two paths {?7i}f^g and {?/j}'/^o (iii) '-'^ Definition 5.1 



n— 1 m—1 
i=0 j=0 



Taking j — )■ cxd and using the martingale convergence theorem proves the closed loop property holds for 
F,. □ 

The proof of Theorems 5.3 and 3.1 is thus complete. □ 
6. Proof of Theorem 2.1 

We will now present the proof of the main theorem. Note first that for all fc > and P-a.e. uj, 

P^{S+{Tx^UJ,Zk+l,^) = (rA-fc + iW,Zfe+2,oo)} = 1- 

Thus, the empirical measure Rli'°° comes deterministically close to the set of S'+-invariant measures and 
every non-5^-invariant measure has a neighborhood that has zero probability for all large enough n. Since 
the set of such measures is open and function H in Theorem 2.1 is infinite on it, we need not be concerned 
with them. 

Recall definitions (3.5) of and (2.6) of H. Now, Lemma 3.2 and Theorem 3.1 imply that an almost-sure 
level 3 large deviation principle holds with rate function sup£>]^ H^* . It remains to identify this rate function 
with the one in the statement of Theorem 2.1. This is shown in the next lemma. 

Lemma 6.1. Assume P is invariant for the shifts {T^} and satisfies assumptions (3.1) and (3.4). If fJ. G 
A^i(r2_|-) is -invariant, then 

sup Hi{ii\ii J = H{^i). (6.1) 
i>i 

In particular, H is convex. If, furthermore, the compactness assumption (2.1) holds then 

snpHr{fHnJ = H**{fi). (6.2) 
e>i 

Proof. Let us start with the first identity. Assume /ig ^ P since otherwise the equality holds trivially. Let 
Z^^'' be the law of (w, Zi_^.o) under /^_. Then, the S'"'"-invariance of /i implies that 

Hooif) ==^supij£(^|fjj = supinf{i7(^L^^ x q \ ^L^' x p^) ; q £ Q(Q.i) and /^^^q = pL-f^}. 

e>i e>i 

Recall the universal kernel q that corresponds to all S'+-invariant measures fi G Aii{fl+). Let 

q^'HC 57 C) = E^^- [qirj, S^rj) \ r;i_,.o = (]■ 

Then, ^'"S^ is q^^'-invariant. Moreover, ^^S* x g^^^ is the restriction of /i_ x q to il'j. Thus, II(p,^^ x g'^) | ^'^'^ x 
p~) < II{^- X q \ fi- X p~). This shows that HooifJ-) < II{^J■)■ 

The other direction is trivial if HodfJ') = oo. On the other hand, if Hooif) = h < oo, then there exists a 
sequence q'^^ S Q{fle) such that is gff^-invariant, and 

Hi^l^_'^ xq^^'^l^i^^^ xp-)<h + r\ 

This implies that, for /iL^^-a.e. 77 S fii, q^l\r], {S~r) : z G ^}) = 1. 
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For ^ > measures /iff' x g^-* have marginals /i*^ Thus, for fixed, measures ^^f^ x q'ff'' restricted to 
are tight. We ean use the diagonal triek to extraet one sequence that converges weakly on all spaces Vlf, 
simultaneously. By Kolmogorov's extension theorem one can find a limit point Q G Ali(Jl^). The marginals 
of Q are equal to /i_ and hence the conditional distribution of the second coordinate Q under Q, given the 
first coordinate ry, defines a kernel q^{r], dC,) that leaves invariant. The following entropy argument shows 
that is still supported on S'j-shifts; that is 



0{(77,C)ef2_:Ceu,{5-77}} = i. 



(6.3) 



For any e > 0, there exists a compact subset C such that iJ.-{K^ x ^^-) > 1 — £. On the other 
hand, for any finite A C ^ the function w i— > F{u!,A) = J2z£A''^o.zi'^) is continuous. Furthermore, this 
function increases up to 1, for all ui, a.s A increases to Thus, for each u in choose a set A so that 
F{uj, A) >1 — e/2 and pick an open neighborhood G of w so that for w' € G, F{uj\ ^) > 1 — e. Since is 
compact, it can be covered with finitely many such neighborhoods. Let As be the union of the corresponding 
sets A. Then, Ae is finite and F{ll!, Ae) > 1 — £ for all G K^. In fact, we can and will choose As to increase 
to ^ as e decreases to 0. 

Now recall the variational characterization of relative entropy (see Lemma 10.1 in [21] or Theorem 6.7 in 
[15]) and write 



h + l> H{^i 

it 

> E''- 



> E"- 



X q_' I X p ) 



sup{Y,q^-\ri,S;r^)fiS;r^) - log^^o..(^)e^(^^""'} 

^ z z 

sup { q'l^ (7?, S-ri)f{S-Ti) - log 7:o,z (c^)e^(^^"'') } 1^^ (rj) 

^ Z Z 

[C Y q^^\v,S^v)~logJ2^oA^)^''^^''^-^'^}^K^.^'(-^)_ 

{C Y 9^'' (r/, 5777)- log (l + (e^-l) ^ ^U^))}^K.x^'iv) 

Z^Ae Z^Ac 

[C Y <l-\v,SZv) - log(l + (e^ - l)e)}lIx.x^K'7) 



z^Ae 



In the third inequality we used /(?y) = C]I{zo ^ Ae}. Now, fix a 5 > and choose C large such that 
(1 + h)/C < (5/2. Then choose £ > small such that C"^ log(l + {e^ - l)e) +e < 6/2. The above inequalities 
then become 



< C~\l + h) + C~Hog{l + {e^ - l)e) + I - n^f {Ke x ^^) < 5. 

z^Ae 

Since {(77, C) G ■ Ci-e'.o = '5'r'7i-«',o and z G Ae} is closed it follows that 
Q{{r],C) e : Ci-f',0 = S^m-tfi and z G Ae} 



> lim /iff' X q'^I^ {(m-ifiXi-efi) e : Ci-r,o = and z G Ae} 

i—>-oa 



> lim /i!_^ X ql'{{r]i^ifi, m-i,o) ■ m-i.o G , z G Ae} >l-d. 
But {(?7, C) : 7? G r2_, C = S~r], and z G .4e} is equal to the decreasing limit 
Pi {(r/,C) G fll : Ci-^',0 = S-rji-e'fi and z G A}- 
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Now, taking 5 — > then e — > proves (6.3). Since there is a unique kernel that leaves invariant and is 
supported on S'j-shifts, Q = /i_ x g is the only possible limit point. Lower semicontinuity of the entropy 
implies that 

H({^i^ X g)|j^2 ifi^ xp-)|j^2 ) < lim H({^i'^_^^ X £^^)|o2, (^L^^ xp-)|j^2 ] 

< lim X gi''^ I Aiff^ X p-) < /i. 

Taking £' ^ oo proves that H{^) < Hao{^j) and (6.1) holds. 
Next, we prove (6.2). First, we show that for /i e A^i(Jl^), 



H({fi) = inf{iJ(!^) : is 5^-invariant and ly^fi^ = /i} 



(6.4) 



If /io 1^ ]P then both sides are infinite. Suppose /.io <C P. Write temporarily I{iy) = sup^ Hg*{i^^fiJ for the 
level 3 rate function. If ly is 5+-invariant and i^o <C P then by (6.1) 

= snpHr{iy\n,) = sup i/£(t^|j,J = H{iy). (6.5) 

By the level 3 to level 2 contraction, 

H({fi) = H^*{ii) — inf{/(;^) : ly is S''^-invariant and i^ij^^ = fj,}. 

Since I < H, to prove (6.4) it suffices to consider the case Hi{ijl) < oo. Only S'+-invariant measures have 
finite level 3 rate, hence there exists at least one 5'"'"-invariant v such that v^fi^. = /i. Furthermore, the 
measures v that appear in the contraction satisfy vo = P, and so by (6.5) equation (6.4) follows. 

Now, consider S'"'"-invariant measures v. By (6.1) I < H, and since / is a l.s.c. convex function, also 
/ < H**. By (6.4) and the basic Lemma (A.2), 



H^*{fj,) = inf{i7**(i^) : v is S'^-invariant and 



fi}. 



Outside S'+-invariant measures H** = oo so whether or not the invariance condition is included in the 
infimum is immaterial. 

Let c > For each £ use above to find /j,*^^^ such that ^|^'^ = ;/|Of and i/**(/i*^^)) < c. /j,*^^) — > v and so 
by lower semicontinuity H**{v) < limi7**(/x(^)) < c. This shows H** < I. □ 



Appendix A: Technical Lemmas 

Lemma A.l. Let g be a bounded measurable function on a product space X x y, ^ a probability measure 
on X and p a probability measure on y . Then 

log/ e^y^'^'^'y^P^'^y^ jjL^dx) < [ [log/ e^'-^'-y^ n{dx)] pidy). 
Jx Jy Jx ^ 

Proof. The inequality can be thought of as an infinite-dimensional Jensen's inequality, applied to the convex 
functional \E'(/) = log e^'^^^ p{dx). Proof is immediate from the variational characterization of relative 
entropy; see Lemma 10.1 in [21] or Theorem 6.7 in [15]. First for an arbitrary probability measure 7 on X, 



log / es(^^^) p{dx) p{dy) > 
'x J Jy 



g{x,y)-f{dx) - H{-f\p) p{dy) 



X 



X 



g{x, y) p{dy)\ j{dx) - H{-f \ p) = log / e^v s^^^^^^ "^'^^^ p{dx) 
y Jx 



where the last equality comes from taking 



^{dx) 



X 



□ 
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Lemma A. 2. Let § and T he compact metric spaces and tt : § — >■ T continuous. Let / : § — > [0, oo] 
he an arhitrary function and /isc(s) — limr\,o inf:ces(s,r) /l^^) '^-^ lower semicontinuous regularization. Let 
g{t) = mi^(^s)=t f{s)- Then g\sc{t) = inf^(s)=t /isc(s). 

Proof. Immediately gisdt) > mf^(s)=t /isc(s) because the function on the right is at or below g(t) and on a 
compact metric space it is l.s.c. 

Let c > inf^(jj)^j /isc(s)- Fix s so that 7r(s) = t and /isc(s) < c. Find — > s so that f{sj) < c (constant 
sequence sj = s is a legitimate choice). Then Tr{sj) — ?► t, and consequently 

gisc{t) < limg(7r(.Sj)) < lim/(sj) < c. □ 
Appendix B: Proof of Lemma 5.1 

In what follows, C denotes a chameleon constant which can change values from line to line. The only values 
it depends upon are and d. Cr is again a chameleon constant but its value also depends on r. Finally, 

Cr{oj) also depends on w. Note that ^ > 1 is a fixed integer, throughout this section. 

Recall that xg = zi + . . . + zi. Similarly, = zi + . . . + . Under (3.4) there always exists a path from 
(y, zi^i) to (x, zi,i) in the sense that there exist m > £ and ai, . . . , Om-e G ^ such that 

y + Xi + ai ^ h Om-e = x. 

The definition is independent of zi.f but for symmetry of language it seems sensible to keep it in the 
statement. The case m = £ is admissible also and then y + xg = x. Then if we set am-i+i,m = zi^t, the 
composition 5+^ o • ■ • o 5+ takes {TyUi, zi_i) to {T^io, zi^i) for all uj Q Q. 

Paths can be concatenated. If there is a path from (y, zu) to (x, zi^i) and from (m, zi^i) to {y, zi^i), then 
we have 

y + xg + oi + ■ ■ ■ + a„j_£ — X and u + + 6i + • • ■ + — y. 
Taking b„_£^i n = zi i we then have 

w + if + 6i + • ■ • + fo„ + fli + • • • + a-m-t = X 

and there is a path from (u, zi f) to [x, Zi^g). 

For any two points (x, Zij) and (x, Zi,f) and any zi £ there exists a point y e Z'' such that from (y, Zi,^) 
there is a path to both (x, zu) and (x, zu). For this, find first ai, . . . , a,„_f and ai, . . . , a„_f £ M such that 

X - X = (ai H h a,„_f ) - (ai H h a„_£) 

so that 

y' = X - (ai H h a,„_£) = x - (ai H h a„_£) 

and then take y = y' — Xf . By induction, there is a common starting point for paths to any finite number of 
points. 

Now fix F G ICP{ni X If there is a path from (y, zi^^) to (x, zi^^), set 770 — {TyUJ,zi^e), rji = S'^.'qi-i 
for i = 1, . . . , m so that rfm = {T^ui, zi^e), and then 

m— 1 

L{^, {y, zi^e), {x, zij)) = ^ F{j]i, flj+i). (B.l) 

1=0 

By the closed loop property L(uj, (y, zi^e), (x, zi^e)) is independent of the path chosen. If oi, . . . , Um-i work 
for (y, zi^f) and (x, zi_^), then these steps work also for (y + u,zi^i) and (x + u, zi^f). The effect on the 
right-hand side of (B.l) is simply to shift co by u, and consequently 

L{TuUJ, (y, zi^e), {x, zi,^ )) = L{u, (y + u, zij), (x + -u, zi^i)). (B.2) 
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Next define f : n x M'^^ x I.'^ ^ R hy 

f{uj, zi^g, zi^i, x) ^ L{uj, (y, zi^i), (x, zi^i)) - L{oj, {y, zi^g), (0, zi^g)) (B.3) 

for any (y, zi^^) with a path to both (0,zi^^) and (x,zi^£). This definition is independent of the choice of 
{y,zi,i), again by the closed loop property. 

Here are some basic properties of /. We postpone the proof of this lemma to the end of this section. 

Lemma B.l. Same setting as Lemma 5.1. 

(a) There exists a constant C depending only on d, £, and R = max{|z| : z £ M}, such that we have for 
all zi^i, zij £ , X S Z'^, and P-a.e. u, 

\fiuj,zij,zij,x)\ < max^ ^ \F{TbUj, zij, z)\. 

z&Sl b-\b\<C\x\ 

(b) The closed loop property of F implies that for any zu, z\^i g Si^ , x,x € , and P-a.e. uj , 

/(T^w, zi_£, X - .t) = f{u:, zi,u zi,u x) - /(w, z^^i, z^^i, x) 
= f(y>-, zi,e, zi,e, x) - /(w, zij, zi^e, x). 

(c) The mean zero property of F implies that for any zij G and x G Z'', E[/(aj, zi/, zi/, x)] = 0. 

Next, extend / to a continuous function of ^ G M'' by linear interpolation. Here is one way to do that. Recall 
that {ei, . . . , Cd} is the canonical basis of R''. Introduce the following notation: for p G [0, 1] and i G {1, . . . ,d}, 
let Bi[p) be a Bernoulli random variable with parameter p. For a vector p = {pi, . . . ,pd) G [0,1]'^, let 
B{p) = YH=iBi{pi)ei with {Bi{pi)) independent. 

Now, for given r;, zi_i, and ^ = X^iLi^jSi, let [£] ~ SiLifel^ji where [^i] is the largest integer smaller 
than or equal to ^i, and define 

/(77, = i?[/(77, [C] + S(e - K]))]. 

Think of / as a collection of functions of {i^,Cl- The idea is to homogenize these functions by showing 
that, for fixed zi^i and zi^i and for P-a.e. w, (7„(w, zi^£, zi.^, ^) = n^^ f{{uj, zi^i), zi^£,n£,) is equicontinuous 
and hence converges, uniformly on compacts and along a subsequence, to a function g{uj, zi^i, zi^i, ^). Next, 
one shows that g has to be constant and since g{u!, zi^e, zi/, 0) = we conclude that gn converges uniformly 
on compacts to 0. Observe now that if 770 = {uj,zi^() and rjk+i = S'^^^_^rjk for < fc < 71 — 1 and Ok G 
then 

n-1 
k=0 

where ^ = {xi + ai + ■ ■ ■ + a„-i)/n and zi,£ = {a„-e+i, . ■ . ,a„). Thus, 



max 



'^y^ F{r]k,ak+i) < max sup |g„(a;, zi,£, zi,£, ^)|, 



k=0 



where R = max{|z| : z G This completes the proof of the lemma. 

The above strategy was introduced by Kosygina, Rezakhanlou, and Varadhan [12] in the context of 
diffusions with random drift, then carried out by Rosenbluth [17] for random walk in random environment 
in the case £ = 0. Equicontinuity follows from an application of the Garsia-Rodemich-Rumsey theorem (see 
[20]) which requires the moment assumption on F. The fact that g is constant follows from an application 
of the ergodic theorem along with the mean property of F. We present the proof, adapted to our setting, 
for the sake of completeness. 

Let us start with equicontinuity. This will be shown by breaking the space into two parts. Each of the 
following two lemmas covers one part. Let us denote Br{^) — {( £ M.'^ : \C ~ ^\ < r}. 
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Lemma B.2. Same assumptions on P and F as in Lemma 5.1. Then, for any r > 1 and any 7 G (0, d + p), 
one has that for P-a.e. uj and all zi^i, z\^i S S^^ 



lim 

n— >c« 



r(o) ^B2d/„(C)ni3,(o) IC-CI'^ 
Proof. Changing variables, the above integral can be rewritten as 



1 



1 



,2d+p-7 



B„.(0) JB2d(?)nB„.(0) 



1/(0 -/(or 



(B.4) 



where we dropped w, zi_^. and z^ i from the arguments of / for the moment. 

Observe next that if C is on the boundary of a Z'^-cell, i.e. Ci G Z for some i £ {1, . . .,d}, then the fact 
that (i + Bi{0) has the same distribution as Ci ^ 1 + -Bj(l) shows that one can set [Q] to be either Q or Q — 1 
and the value of / at C would not be affected. 

Therefore, if ^ and C belong to the same Z'^-ceW, we can assume that [^i] = [Q] = x, the lower left corner 
of the cell. Abbreviate pi ^ d ~ Xi and qi = — Xi . Then 

1/(0 - /(Ol = 1^^1/(2; + S(C - x)) - fix + B{i - x))]\ 



£{0,1}'' » 

n9.?'(i-<zo'"''' ■ /(^+E^ 



\i-f>i 



/(^) 



E |^^^^(l-^■ 

<cic-ei E |/(a: + E^*^^) -/(^) 

(bi)e{o,i}'' i 
where we have used the fact that for a, 6, c, d G [0, 1], 

\ah ~ cA\ < |(a - c)b\ + \{b - d)c\ < \a - c\ + \b - d\. 

If, on the other hand, ^ and ( are in two different Z'^-cells then, since I'f — CI ^ there exist points 
Coi ■ • ■ ,Cm, with m < C, such that Co = Cm = Ci each two consecutive ones belong to the same Z''-cell, 
and ICfc+i — Cfel ^ C' IC ~ ^1- One can then write 

rn— 1 

\f{0-fm<cY,\Ck+i^<:k\ E \f{iCk]+Y.b.e.)^f{Kk 

ni— 1 

<^IC"OE E \f{iCk]+J2b^e^)-f{Kk]) 

771 — 1 

= C'|C-OE E |/(^[a]'^'^i.^^i.^E^* 

fc=o ((,.)e{o,i}'i i 

where we have used part (b) of Lemma B.l. Furthermore, using part (a) of the same lemma, and that 
ICfc-K]|<C|e-CI<C, wehave 

1/(0 - /(Ol < IC - ?l JTiax max max |F(T,o., fi,,, z)\. 
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Since d + p > 7, one has that /^^^^j^) |C ~ ^\^~''d( < 00. Setting, 

G(u)= max max max \F(T^ui, Si i, zW e L^(F), (B.5) 

zi,«e5?* zest x:\x\<C I ^ ^ 'I ^ ' 

integral (B.4) is then bounded by 

y:\y\<rn 

The lemma follows sinee d + p > 7 and, by the ergodie theorem (see for example Theorem 14. A8 in [9]), the 
quantity in parentheses converges to a finite constant. □ 

Lemma B.3. Same assumptions on P and F as in Lemma 5.1. Then, for any r > 1 and any 76 [d + p ~ 

l,d + p), there exists a constant Cr such that for F- a. e. u) and all zi^i,zi^i G 



lim 



dCd^ < Cr 



lB,.{0} JS.(0)-vB2d/„(5) 

Proof. Once again, changing variables the above integral becomes 



1 



Br„(0) JS„.(0)-^B2d(C) 



Write 

i/(e)-/(c)i<i/(K])-/([c])i 



i/(e)~/(c)r 



dCd^. 



(B.6) 



/([C]) 



Observing that 7 > 1, 7 < d + p, |C — CI > 2(i, and |[C]| < C|C| < C^n, the second and third terms above are 
dealt with exactly as in the previous lemma (using the ergodie theorem). For example. 



1 



n^d+p — I 
< - 



fm) 



n 



B™(0) J B„,{0)-^B2i{0 

c 

2d+p-7 



IC-CI^ 

-fm) 



■dCd^ 



d^ 



I |/(k]+E^ 

y:\y \ <rn 

Observe next that since |^ — CI > 2d, 1 < | [C] — [C] I !i C7 |^ — ^| and we are reduced to bounding the sum 



1 



2d+p-j 



E 



x,y.x^y 
\x\,\y\<rn 



\f{x)-f{y)\P 

Ix-yl-r 



Now, 1/(0;) — f{y)\P < C m'P~^ TlT^i ^C^XiOj), where G was defined in (B.5) and {xi) is any path in from 
X to y, with length m < C \x — y\. If one chooses canonical paths that go from each x to each y and that 
stay as close as possible to the line connecting x and y, e.g. staying at distance less than d from the line, 
then the above sum is bounded by 



n 



1 

2d+p — I 



s:\s\ <.Crn 
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X 

Fig 1. y count. 



where 



^s,ri,7 = |a: — ^ '''ll{s is on the canonical path from x to y}. 



\x\,\v\<rn 

Consider a fixed s. For a given integer pi, there are at most Crpf~^ x's such that |a; — .s| ~ pi. Fix such 
an X. See Figure 1. Because the line joining x and y has to be within a bounded distance of s, radius i? is 
bounded by 

R < P2 sm{9 + ip) < P2{sm9 + s'mip) < C(l + P2/pi)- 

Hence, there can be at most (7^(1 + P2/ PiY^^ possible y's with |y — s| = p2 being a given integer. Thus, 
there are at most Cr{pi + P2)'^~^ pairs {x, y) that have s on the canonical path joining them. Furthermore, 
Pi + P2 < Cr\x — 2/1 . Therefore, 

CrTl 

Pl,P2 = l 

This allows us to bound the above sum by 

sGZ<':|s|<Crn 

which, by the ergodic theorem, converges to a constant. □ 
We have shown that for a fixed r > 1, ifd + p— 1 <7<(i + p, then for all Zi^i and zi^i and P-a.e. ui 

sup/ / 1- — -7- ^ '■ dCd^ <Cr{uj). 

Next, we apply an extension of Theorem 2.1.3 in [20]; see Exercise 2.4.1 therein. 

Garsia-Rodemich-Rumsey's Theorem. Let g : ^ M. be a continuous function on Br{0) for some 
r > 0. Let 7 > 0. // 

15(0-5(0 
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then for ^ ■Br/2(0); 

i5(6-5(c)i<c;ic-cr^^ 

where C'j. depends on Cr and the dimension d. 
From this theorem it follows that 

sup|g„(a;,zi,£,zi,£,^) - 5r„(cj, zi,^, zi,^, C)| < Cr{uj) \£, - CU"^'^ . 

n 

Since 2d < d + p, there exists a suitable 7 such that j — 2d > 0. This shows that {gn(u!, zi^i, zi^i,^)} is 
equicontinuous in ^ G Br(0), for all r > 1. Let g{uj, zu, zij,£^) be a uniform (on compacts) limit point, for 
fixed uj. 

Now compute, for any fixed io G {1, ■ • • , d} and ^ = X^iLi ^i^i with > 0, 



-,-(d-l) 



0<fci<[< 
l<i<d.i^io 



< 



E 5J^e.„ + E^^ 



E 



0<ki<[nii] 



0<fci<[nCi] 



K.q] 



/ n 



0<fei<[n{ 
l<z<d,2^zo 



(B.7) 



(B.8) 



The term on line (B.7) converges to because of the uniform convergence of g„ to g and the term on line 
(B.8) converges to because g is continuous and the sum is a Riemann sum. Similarly, 



-(d-i) 



l<i<d,i^iQ 

converges to 0, as ri —!> cxd. 
On the other hand, 



E E - / n ^ < E 0^.) n 



E ^^"(^^^o + E^^ 



0<fci<[n4i] 

l<2<(i, 2^^:20 



E /([<«J^-^o + E 

0<A;i<[n4i] j ■ " 

l<.i<.d,i^iQ 

' E {/(e.o+Efc. 

o<fci<[<i] i 

l<i<d 

-'^ E G"(T.a;), 



E ^"(ETfe: 

0<fci<[n{,] J^io 
l<i<d,i^io 

E /(EM 

l<2<d,Z7^20 



/(E%^.)} 



where G"(w) = f{u,zi^e,zi^i,ei„) e L^{F) and 



14 = |a- = E^«Si : < fc, < [n^i],Vi|. 



j=i 



Quenched LDP for RWRE 



27 



For the last equality above we used (b) of Lemma B.l. By (c) of Lemma B.l we have E[G"] = and the 
ergodic theorem implies that the above converges to 0. 
We have thus shown that 

j n < cj5(?^oe.o + E o^j) n - / n < o < e o^,) n 

which implies that 

/ n li^^' ^ < 6}5(C.oe.o + E 0^.) n = / n ^^^^ ^ < + E Oe,) J] 

and hence g is independent of , for all io G {Ij • • • , f^}- This means (7(0;, zi^f, = 3(<^i j i 0) = 0- 
In other words, g„ converges uniformly (on compacts) to g = 0. Lemma 5.1 is thus proved. 

Proof of Lemma B.l. Recall that {ei, . . . , e^} be the canonical basis of . For each \ < i < d. there 
exist rii, m^, {ai.j)^^^, and (a^.j)™!]^ from J% such that 

^2 ^z,l "i" ■ ' ■ ^" ^z,mi ^i.l ' ' " ^i,ni • 

Write a; = X]f=i ^i^i- Then, 



E E ^'""^'i " E E 



One can thus find a y that has a path to both and x and such that \y\ < C\x\. This proves (a). 

To prove (b), let {y, zi^i) have a path to both (a;, Zi^i) and (x, zi,i). Find (y', ^) that has a path to both 
(y,zi^e) and (0, Then, from (B.3), 

/(W, , X) ~ f{uj, Zi^i, Zij, x) 

= L{uj, (y', z[ ,,), (y, zij)) + (y, zij), (x, zi^^)) - (y', zj^^), (0, zi,f)) 

- L{uj, {y, z\ i), (y, zi/)) + L(a;, (y, zi,^), (x, z^.i)) - (y', Zj^^), (0, zi,^)) 
= L(a;, (y, zi,^), (x, zi^^)) - L(a;, (y, zi^f), (x, zi,f)). 

The last line above is independent of z\^i so we can substitute z\^i for z\^i and get the second equality of 
part (b). For the first equality, by the definition of / (B.3), the shift property (B.2), and the second equality 
in (b) just proved, we have for a new (y, zi,^) 

/(T^a;,zi^f,zi^f,x - x) 

= ^(TlcW, (y, zij), (x - X, zij)) - L(rj;W, (y, zi,<;), (0, zij)) 
= Huj, {y + X, zi^i), (x, zi^i)) - L{uj, (y + X, Zi,^), (x, zi,^)) 

= /(W, Zl^£, Zl^£, X) - /(W, Zl_£, Zl_£, x). 

For (c), by the earlier observation, we can choose y so that from (y, zi^i) there is a path to both (x, zi^i) 
and (0, zi,^). Then 

/(w, zi,£, zi,^, x) = L(w, (y, zi,£), (x, zi,£)) - L{oj, (y, zi,^), (0, zi^^)). 
Both L-terms above equal sums YliLo^ FiVii Q-i+i) where rj^ ~ {TyUJ, zi^i) and 77™ = (T„a;, zi f) with u = x 



or u ~ 0. Both have E-mean zero by property (ii) of Definition 5.1. 



□ 
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